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ABSTRACT 

The  design  of  controllers  to  provide  quasi-minimum 
time-response  is  investigated.   With  the  control  law  to  be 
realized  as  a  piecewise-linear  combination  of  the  instan- 
taneous state  values,  the  problem  is  to  select  the  para- 
meters which  define  the  best  suboptimal  switching  surface. 

A  worst-case  response-time  performance  index  is  de- 
fined and  shown  to  be  suitable  for  use  in  the  suboptimal 
controller  design.   A  proposed  design  technique  is  describ- 
ed and  used  to  determine  controllers  for  second-order  sys- 
tems.  The  results  of  the  illustrative  examples  are  compar- 
ed with  controllers  designed  using  a  least  squares  polyno- 
mial fitting  technique.   The  comparison  shows  that  the 
proposed  method  designs  significantly  better  controllers 
in  terms  of  deviation  from  optimal  response  time. 


DUDLEY  KNOX  LIBRARY 

NAVAL  POSTGRADUATE  SCHOOL 

MONTEREY  CA  93943-5101 


TABLE  OF  CONTENTS 

Page 

1.  INTRODUCTION  7 

2.  THE  PIECEWISE-LINEAR  SWITCHING  FUNCTION  H 

2.1  The  Optimal  Switching  Surface  11 

2.2  The  Piecewise-Linear  Switching 

Surface  14 

2.3  Effects  of  PWL  Switching  17 

3.  SELECTION  OF  AN  INDEX  OF  PERFORMANCE  21 

3.1  General  Comments  21 

3.2  Response-Time  Summation  Indices  22 

3.3  Non-response-Time  Indices  28 

3.4  Worst-Case  Response-Time  Indices  31 

4.  DESIGN  OF  THE  PWL  SWITCHING  SURFACE  35 

4.1  Steps  of  the  Design  Procedure  35 

4.2  Selection  of  the  Initial  Conditions 

and  Their  Range  37 

4.3  Selection  of  the  Number  of  PWL 

Segments  39 

4.4  Searching  the  Cost  Surface  40 

5.  DESIGN  OF  SECOND-ORDER  CONTROLLERS  43 

2 

5.1  Double  Integrator,  1/s  ,  Design  Example    43 

5.2  l/s(s+a)  Design  Example  48 

5.3  Comparison  of  Design  Methods  52 

6.  SUMMARY  55 

6.1  Discussion  of  Results  55 

6.2  Areas  for  Further  Study  56 


Page 

BIBLIOGRAPHY  58 
APPENDIX  A:   Pattern  Search  for  Cost  Index 

Minimization  59 

APPENDIX  B:   Computer  Programs  63 


LIST  OF  ILLUSTRATIONS 

Figure  Page 

1.  Optimal  Controller  8 

2.  Minimum-Time  Trajectories  13 

3.  Composite  Minimum-Time  Trajectories  14 

4.  The  PWL  Switching  Surface  16 

5.  Effects  of  PWL  Switching  17 

6.  Multiple-Segment  PWL  Switching  19 

7.  One-Segment  PWL  Switching  23 

8.  Cost  Surfaces  for  Summation  Indices  25 

9.  Cost  Surfaces  for  4  and  10  Initial 

Conditions  27 

ID.  Transverse  Trajectory  Time  30 

11.  Cost  Surfaces  for  Worst-Case  Indices  33 

12.  Additive  Constant  in  the  Response  Time  38 

13.  One-Segment  Controller  44 

14.  Optimal  and  Best  One-Segment  PWL  Surfaces  45 

15.  Two-Segment  PWL  Controller  45 

16.  Optimal  and  Best  Two-Segment  PWL  Surfaces  46 

17.  Three-Segment  PWL  Controller  47 

18.  l/s(s+a)  One-Segment  PWL  Controller  50 

19.  Optimal  Switching  Surface  for  l/s(s+a)  50 
2  0.  Comparison  of  Switching  Surfaces  53 
21.  Comparison  of  Controller  Designs  54 


1.   INTRODUCTION 
This  thesis  presents  a  proposed  method  for  the  design 
of  controllers  that  provide  quasi -minimum-time  response  of 
systems  described  by  the  set  of  state  equations 

(1.1)      x(t)  =  Ax(t)  +  Bu(t) 

where 

x  is  an  nxl  state  vector 

A  is  the  nxn  plant  matrix 

u  is  the  bounded  scalar  control 

B  is  the  nxl  distribution  matrix  of  the  control. 
In  order  to  insure  that  an  optimal  control  exists,  the 
plant  transfer  function  is  restricted  to  one  having  only 
real,  negative  eigenvalues,  and  it  is  further  specified 
that  it  have  no  zeros.   Additionally,  all  states  must  be 
observable  and  the  control  effort  bounded. 

For  plants  of  the  type  described,  previous  studies 
[l,3]  have  shown  that  a  unique  optimal  control  will  exist 
that  transfers  the  plant  from  any  point  in  the  state  space 
to  the  origin  with  no  more  than  n-1  switches  of  the  control, 
Furthermore,  the  control  will  always  be  at  its  maximum  pos- 
itive or  negative  value  (i.e.  the  bang-bang  control) . 
Since  the  control  is  always  at  its  maximum  value,  an  ideal 
relay  can  be  used  to  provide  the  control  to  the  plant  if 
some  other  device  can  be  constructed  to  properly  control 
the  relay  as  shown  in  figure  1. 
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Figure  1.   Optimal  Controller 

From  the  figure  it  is  seen  that 

(1.2)      u  =  sgn  cr 
Therefore,  the  controller  must  generate  the  proper  cr  to 
transfer  the  plant  from  x(0) ,  the  initial  condition  vec- 
tor, to  x(f ) ,  the  desired  final  condition  vector,  in  mini- 
mum time.   When  the  plant  input,  r,  is  zero  the  problem 
becomes  that  of  the  linear  regulator  since  the  desired 
state  of  the  system  at  the  final  time  is  the  state  space 
origin.   If  r  is  non-zero  but  restricted  to  an  allowable 
class  of  input  functions,  the  effect  may  be  described  as 
a  shift  in  the  state  origin. 

Time-optimal  control  can  be  implemented  for  the  sys- 
tems considered  in  this  study  by  one  of  two  general  meth- 
ods.  In  the  first  method,  a  digital  computer  is  used  as 
the  controller.   The  computer  must  rapidly  calculate  the 
control  using  the  differential  equations  of  the  plant  and 
the  specific  initial  condition.   The  disadvantages  of  this 
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method  are  that  it  is  open-loop  which  is  undesirable  since 
unexpected  disturbances  are  not  taken  into  account,  and  it 
is  possible  that  the  computer  may  not  be  able  to  generate 
the  solution  rapidly  enough  to  allow  proper  switching  of 
the  control.   The  second  method  of  generating  the  optimal 
control  is  to  determine  a  as  a  function  of  the  state  vari- 
ables of  the  plant  with  some  electronic  device.   While 
more  appealing  than  the  first  method,  this  method  is  lim- 
ited in  application  by  the  fact  that  a  closed  form  ex- 
pression for  the  switching  function  is  not  usually  obtain- 
able for  systems  of  higher  than  second  order. 

In  many  instances  the  complexity  and  cost  of  the  op- 
timal controllers  described  above  is  not  justified  from  an 
engineering  point  of  view.   That  is,  a  less  complex  and 
more  easily  implemented  controller  may  be  acceptable  if  it 
can  be  designed  to  deviate  from  optimal  performance  by 
only  a  "small"  amount.   The  problem  then  becomes  that  of 
developing  a  design  procedure  which  results  in  an  easily 
realized  controller  that  produces  acceptable,  suboptimal 
response  of  the  plant. 

In  this  investigation  a  suboptimal  design  method  is 
developed  using  a  controller  of  a  pre-specif ied  form.   The 
parameters  of  the  controller  are  adjusted  to  provide  ac- 
ceptable time  response  of  the  plant.   In  the  state  space 

* 
the  optimal  switching  function,  cr  ,  consists  of  a  hyper- 
surface  that  divides  the  space  into  regions  of  +M  and  -M 
control,  where  |  M  |  is  the  absolute  magnitude  of  the  bound- 


ed  control.   Throughout  the  remainder  of  this  study  it 
will  be  assumed  that  all  equations  are  normalized  so  that 
I  M  I  =1.   It  would  seem  that  the  switching  function  gen- 
erated by  the  suboptimal  controller  should  be  a  hypersur- 
face  that  lies  "close"  to  that  generated  by  the  optimal 
controller. 

The  suboptimal  switching  function  used  in  this  work  is 
a  piecewise-linear  combination  of  the  state  variables  of 
the  system. 

In  Section  2  the  optimal  and  suboptimal  switching  sur- 
faces are  described.   Selection  of  an  index  of  performance 
is  the  topic  in  Section  3.   An  outline  of  a  proposed  design 
procedure  for  suboptimal  controllers  is  presented  in  Sec- 
tion 4  and  Section  5  gives  the  results  of  suboptimal  con- 
troller designs  using  the  proposed  procedure  and  compares 
the  designs  with  controllers  designed  by  another  method. 
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2.   THE  PIECEWISE-LINEAR  SWITCHING  FUNCTION 
2.1   The  Optimal  Switching  Surface 

For  time-optimal  control  the  switching  function  di- 
vides  the  state  space  into  areas  of  -1  control.   The 
closed  form  of  the  optimal  switching  function  as  a  func- 
tion of  the  system  state  variables  can  be  expressed  as 

(2.1)  a*  =  f*(x)  =  0 
Alternatively,  this  function  can  be  expressed  as 

(2.2)  CT*  =  f*(x")  -  x.  =  0 

where 

*  indicates  optimal 

x'  is  the  previous  x  vector  with  the  x.  component 

removed 

if  the  function  is  single  valued  in  x. .   The  function 

* 
f  (x ' )  is  independent  of  x.  and  gives  the  x.  coordinate  of 

the  optimal  switching  surface.   For  plants  of  the  form  pre- 
scribed for  this  study,  Smith  [2]  has  shown  that  the  sur- 
face can  be  made  single  valued  in  the  uncoupled  state  vari- 
ables by  transforming  to  Jordan  canonical  form.   In  many 
instances,  however,  the  optimal  switching  surface  is  al- 
ready single  valued  in  at  least  one  state  variable  so  that 
no  transformation  is  necessary. 

Since  n-1  switches  of  the  control  are  required  to 
transfer  the  system  from  any  initial  point  to  the  state 
space  origin  in  minimum  time,  the  optimal  switching  sur- 
face may  be  generated  by  integrating  the  state  equations 
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backwards  in  time  and  switching  the  control  n-2  times. 
This  procedure  generates  one  half  of  the  optimal  surface. 
The  other  half  is  easily  obtained  since  the  surface  is  an 
odd  function  of  the  state  variables  for  a  linear  system 
with  symmetrical  control. 

The  optimal  switching  surface  and  trajectories  for  a 
second  order,  double  integrator  plant  may  be  obtained  by 
solving  the  differential  equations  of  the  plant, 

xx(t)  =  x2(t) 
(2.3) 

where 

u  =  +1. 

Using  classical  methods  to  solve  these  equations  with  a 
given  set  of  initial  conditions  x(t  )  yields 


X2(t)  =  u 


for  u  =  -1 


X1(V  =  W  +  tx2^to)  "I"* 


(2.4a) 

x2   f   =  x2   o   ~  *" 
for  u  =  +1 

x,  (tj  =  x,  (t  )  +  tx0(t  )  +  il  t 
It      1   o       2   o     2 

(2.4b) 

x_ (tr)  =  x_ (t  )  +  t. 
2   f      2   o 

i  , 

The  minimum-time  trajectories  in  the  state  space  may  be 

obtained  by  eliminating  the  variable  t  and  solving  for 

■ 
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x,  (t)  in  terms  of  xJt)  which  results  in  the  well  known 
families  of  parabolas 


(2.5) 


x,  (t)  =  -J   x2(t)  +  C,     for  u  =  -1 


x1{t)    =  2   x2(t)  +  C2     for  u  =  +1 


The  families  are  shown  in  figure  2. 
x 


(b)  u  =  fl 


(a)  u  =  -1 


Figure  2.   Minimum-Time  Trajectories 
To  force  the  states  of  the  system  from  a  set  of  random  ini- 
tial conditions  in  the  state  space  to  the  origin  in  mini- 
mum time,  the  families  shown  above  must,  generally,   be 
combined  to  produce  the  minimum-time  trajectories  as  shown 
by  Pontryagin  [l].   Four  typical  trajectories  are  shown  in 
figure  3. 
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Figure  3.   Composite  Minimum-Time  Trajectories 

From  point  (a)  the  minimum-time  control  sequence  is  u  =  -1 
followed  by  a  switching  to  u  =  +1  when  the  trajectory  in- 
tersects the  u  =  41  parabola  that  passes  through  the  ori- 
gin.  For  point  (b)  the  opposite  sequence  must  be  follow- 
ed.  Since  points  (c)  and  (d)  are  on  the  parabolas  that 
pass  through  the  origin,  no  switches  of  control  are  re- 
quired,  (c)  and  (d)  can  reach  the  origin  with  n-2  switches 
of  control,  therefore  they  lie  on  the  optimal  switching 
surface,  in  this  case  a  line,  which  from  equation (2. 4)  is 

1 


(2.6) 


x- 


2  X2  '  X2 


2.2   The  Piecewise-Linear  Switching  Surface 

Since  the  suboptimal  switching  function  specified  in 
this  study  is  a  piecewise-linear  function  of  the  state  var- 
iables of  the  system  it  can  be  expressed  as 
(2.7)      (J     •  f(x')  -  xL  =  0 
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where 

A  indicates  suboptimal 
For  the  second-order  systems  considered  in  this  investiga- 
tion the  switching  surface  reduces  to  a  line  in  the  state 
space  and  is  given  by 

(2.8)    x2  -  [P(l)/P(2)]x1  l(x1)+C-P(l)/P(2)x1+P(l)] 

L 
H(Xl-P(2)  +^{A(i)x1  l[x1-P(2i-2)] 
i=2 

+[-A(i)x1+P(2i-l) ]  UCx1-P(2i)] 


where 


A(i)  =  [p(2i-l)-P(2i-3)]/[P(2i)-P(2i-2) ] 

H(arg)  =  1     (arg)  ^  0 

=  0     otherwise 

L  =  number  of  PWL  segments 

P(odd)  =  x„  coordinates  of  breakpoints  in  the  PWL  sur- 
face 

P(even)  =  x,  coordinates  of  breakpoints  in  the  PWL 
surface. 
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Figure  4.   The  PWL  Switching  Surface 
For  the  purposes  of  this  paper  it  will  be  assumed 
that  the  range  of  initial  conditions  is  known.   P(2L)  will 
be  determined  by  this  expected  range.   The  design  proce- 
dure must  determine  the  best,  in  some  sense,  values  for 
the  other  2L-1  parameters  of  the  surface.   The  number  of 
segments,  L,   in  the  pwl  surface  is  not  prespecified  in 
this  design  procedure  since  it  is  desired  to  complete  the 
controller  using  the  minimum  number  of  segments. 

The  implementation  of  the  pwl  switching  surface  is 
easily  accomplished  using  resistors,  diodes  and  batteries. 
Redderson  [4]  has  shown  construction  of  pwl  function  gen- 
erators using  these  elements.   The  objective  of  this  inves- 
tigation is  the  development  of  a  method  for  selecting  the 
best  parameters  describing  the  pwl  surface.   The  remainder 
of  this  study  will  deal  with  the  design  method  develop- 
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merit  --  not  the  physical  construction  of  the  controller. 

2.3   Effects  of  PWL  Switching 

As  described  previously,  a  maximum  of  n-1  switches  of 

control  are  necessary  for  minimum-time  control.   Since  this 

study  deals  with  suboptimal  control/  it  is  of  interest  to 

investigate  the  trajectories  and  switchings  caused  by  the 

suboptimal  switching  surface.   Consider  the  one  segment 

pwl  switching  surface  shown  in  figure  5. 
x„ 


Figure  5.   Effects  of  PWL  Switching 

For  the  case  of  one  segment,  the  pwl  switching  pro- 
blem reduces  to  the  linear  switching  problem  using  tachom- 
eter feedback  for  a  relay  controller  as  described  by 
Gibson  [5]  and  others.   In  figure  5  the  trajectory  that 
intersects  the  pwl  surface  at  point  (a)  will  be  switched 
optimally  and  will  reach  the  origin  in  minimum  time.   All 
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other  trajectories  shown  will  deviate  from  the  optimal  and 
will,  therefore,  be  suboptimal.   The  trajectory  intersect- 
ing the  pwl  surface  at  point  (b)  will  follow  a  u  =  +1  tra- 
jectory until  reaching  (c)  at  which  time  it  will  chatter 
or  bump  down  toward  the  origin.   Any  trajectory  intersect- 
ing between  point  (d) ,  the  point  of  tangency  with  an  opti- 
mal trajectory,   and  the  origin  will  immediately  begin  to 
chatter  and  will  continue  to  do  so  until  reaching  the  ori- 
gin.  Finally,  a  trajectory  intersecting  the  pwl  surface 
below  the  optimal  surface,  such  as  at  point  (e) ,  will  move 
around  the  origin  until  it  again  intersects  the  pwl  sur- 
face and  will  then  bump  to  the  origin.   Due  to  the  nature 
of  relay  chatter  the  states ' of  the  system  can  never  exact- 
ly reach  the  origin  when  bumping  occurs  in  the  final  stage 
of  a  trajectory.   A  system  will  be  considered  to  have 
reached  the  origin  when  the  states  enter  and  remain  within 
a  circular  neighborhood  or  radius  r. 

For  a  multiple-segment  pwl  surface  the  effects  noted 
above  all  occur,  but  the  problem  is  compounded  since  they 
may  occur  on  each  segment.  A  two-segment  pwl  switching 
surface  is  shown  in  figure  6. 
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Figure  6.   Multiple-Segment  PWL  Switching 

From  point  (a)  a  trajectory  will  move  around  the  origin 
until  intersecting  the  pwl  surface  at  (d)  and  then  bump  to 
the  origin.   From  point  (f)  a  trajectory  will  follow  a 
u  =  +1  parabola  to  (g) ,  bump  to  (c) ,    move  around  the  ori- 
gin to  (e)  and  then  bump  down.   The  trajectory  intersect- 
ing at  (b)  will  bump  to  (c)  and  then  follow  the  sequence 
described  above  to  the  origin. 

Redderson  [4]  gives  the  time  it  takes  a  second-order 
system  to  bump  from  x, (t  )  to  x, (tf)  along  a  pwl  segment 


as 


(2.9)     tb  =  5  LogLa    (   j 

1   o 


where 

b  =  slope  of  the  pwl  segment 

a  =  x~  intercept  of  the  segment. 

To  achieve  good  suboptimal  performance  this  bump  time  must 
be  minimized  since  it  represents  the  major  deviation  from 
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optimal  performance.   Bumping  must  also  be  minimized  be- 
cause frequently  repeated  rapid  changes  of  control  are  not 
desirable  in  physical  systems  due  to  the  component  wear 
produced. 
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3.   SELECTION  OF  AN  INDEX  OF  PERFORMANCE 
3.1   General  Comments 

In  order  to  evaluate  any  design  method  for  the  pro- 
posed suboptimal  controller,  an  index  of  performance,  or 
cost  index,  must  be  specified.   The  index  should  indicate 
how  much  the  suboptimal  controller  causes  the  system  to 
deviate  from  optimal  performance.   Since  quasi-optimal  con- 
trol is  desired,  the  optimal  and  suboptimal  responses 
should  deviate  by  only  a  small  amount.   The  cost  index  se- 
lected should  indicate  close  to  optimal  performance  by 
having  a  small  value  which  should  increase  as  optimal  and 
suboptimal  control  deviate  to  a  greater  extent.   For  time- 
optimal  control  the  cost  index  is  defined  as 


(3.1) 


dt  =  t.e  -  t 

t  f      ° 

o 


Minimizing  the  above  index  leads  to  the  time -optimal  switch- 
ing surface  discussed  in  section  2.1. 

The  selected  cost  index  should  generate  a  smooth  cost 
surface  to  allow  easy  location  of  the  minimum.   Three  dif- 
ferent types  of  cost  indices  may  be  defined  for  use  in  the 
suboptimal  problem  as  described  in  this  paper.   The  three 
types  are 

a)  response-time  summation  indices 

b)  non-response-time  indices 

c)  worst-case  indices 

These  three  types  of  indices  will  be  discussed  in  the  re- 
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mainder  of  this  section. 

3.2  Response-Time  Summation  Indices 

Since  the  problem  being  studied  is  that  ©£  qua§i-min= 
imum-time  control,  a  cost  index  that  evaluates  the  design 
on  the  basis  of  the  actual  plant  response  times  under  pwi 
switching  seems  desirable.  Many  indices  of  this  type  may 
be  defined.   Some  examples  are  given  below. 

K 


1    V  * 

(3.2)      1)    ffx  -£  I  t± 


i  -1 
K 


2>    J2  -k     I   W 

i-1 


3>     J3  -  k  I  V  t 


K 

i 


K 


4)    *4 


1   f  /^      *. 
L-J, 


K  t,-  t  * 


«    *S  ^  I  XHt"1-) 


i  I   J 


where   K  =   number   of    initial    conditions 

t ,      pw]    i  •  §6    i  Lme    foa    I     '    Initial 

iditJ 


2/ 


*       .  '         th 

t.   =  optimal  response  time  for  i 

initial  condition 

The  indices  defined  above  are  summations  of  various 
measures  of  system  response  time  and  include  effects  from 
all  initial  conditions  in  the  evaluation.   A  desirable 
feature  for  an  index  would  be  that  it  equally  weight  all 
initial  conditions  regardless  of  their  location  in  the 
state  space.   Of  the  indices  given  above  J.  and  J_  give 
more  weight  to  initial  conditions  further  from  the  origin. 
The  other  indices  give  equal  weight  to  all  initial  condi- 
tions  since  a  normalizing  factor,  1/t  ,  is  used.   It  then 
appears  that  this  normalizing  factor  should  be  used  in 
the  index  finally  selected  for  this  study. 

The  indices  defined  above  all  possess  a  major  limita- 
tion which  appears  only  after  a  detailed  study  of  the  cost 
surfaces  that  they  generate. 


Figure  7.   One-Segment  PWL  Switching 
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Figure  7  suggests  that  if  the  parameter  values  are  adjusted 
so  that  the  trajectory  for  a  particular  initial  condition 
such  as  (c)  is  switched  at  the  optimal  surface,  it  will  be 
truly  optimal  and  the  summation  indices  will  generate  a 
local  minimum  in  the  cost  surface  at  this  parameter  set- 
ting.  As  the  parameter  P(l)  is  varied  the  other  initial 
conditions  will  follow  optimal  trajectories  for  certain 
settings  as  described  above  and  will  cause  additional  lo- 
cal minima.   The  number  of  local  minima  in  the  cost  sur- 
face increases  with  an  increase  in  the  number  of  initial 
conditions,  however,   the  depth  of  each  is  less  since  each 
component  in  the  summation  has  a  smaller  effect  upon  the 
total. 

Figure  8  shows  the  cost  surfaces  generated  by  the  six 
summation  indices  for  four  initial  conditions  as  P(l)  is 
varied  from  -4  to  -8.   The  figure  shows  that  four  initial 
conditions  may  produce  more  than  four  local  minima.   The 
effect  upon  the  cost  surface  of  increasing  the  number  of 
initial  conditions  is  shown  in  figure  9  for  J_  as  K  is  in- 
creased from  four  to  ten.   It  is  seen  that  the  surface  is 
smoothed  considerably  by  the  increase  but  that  the  number 
of  local  minima  is  also  increased.   The  irregularity  of 
the  cost  surface  is  the  problem  that  limits  the  use  of  the 
summation  indices.   Normal  search  techniques  are  not  able 
to  locate  the  global  minimum  but  will  stop  when  a  local 
minimum  is  reached.   With  the  possibility  of  the  search 
terminating  upon  reaching  a  local  minimum  the  parameters 
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of  the  pwl  surface'  selected  may  not  be  the  best  attainable 
and  the  designer  will  not  be  sure  when  the  best  design  has 
been  completed.   Frederick  [6]  has  improved  the  shape  of 
the  cost  surface  generated  by  a  summation  index  by  limit- 
ing the  number  of  pwl  surface  parameters  to  a  number  which 
allows  it  to  be  easily  searched..  Limitation  of  the  number 
of  pwl  parameters  in  this,  fashion  is  felt  to  reduce  the 
ability  of  any  design  procedure  to  arrive  at  the  best  sub- 
optimal  controller. 
3..  3  Non-response-Time  Indices 

In  view  of  the  irregular  shape  and  attendant  search- 
ing difficulties  of  the  cost  surfaces  generated  by  the 
summation  indices  discussed  above,  another  measure  of  sys- 
tem performance  must  be  defined  if  a. controller,  design 
method  is  to  be  developed.   Smith  [2]  has  used  the  well- 
known  least  squares  curve  fitting, technique  to  fit  the  pwl 
surface  to  the  optimal  surface  for  a  specified  set  of  break- 
points in  the  pwl  surface.   The  index  for  this  method  may 
be  defined  as 


(3.3)      J-  I(x*-x   )2 


J=l 

where 

it 

x.  .  =  points  describing  the  optimal  surface  in  the 

independent  variable,  x. 

x. ,  =  points  on  the  pwl  surface  in  the  independent 
variable  corresponding  to  x . 
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P  =  number  of  points  over  which  the  pwl  surface  is 
fitted. 
The  object  of  Smith's  design  method  is  to  minimize  this  in- 
dex which  represents  the  sum  of  the  squared  distances  be- 
tween points  on  pwl  and  optimal  surfaces  measured  in  the 
coordinate  direction  of  the  independent  state  variable. 
Using  the  analytic  least  squares  technique  the  desired 
minimization  is  easily  accomplished.  For  one  pwl  segment 
with  one  variable  parameter  this  index  generates  a  smooth 
parabolic  cost  surface  which  is  easily  searched. 

While  simple  in  concept  and  implementation,  the  above 
method  suffers  from  the  fact  that  it  does  not  guarantee 
good  time  response  of  the  plant.   It  only  assures  that 
the  pwl  surface  will  lie  close  to  the  optimal  surface. 
Actual  system  response  time  is  never  considered  in  the  de- 
sign of  the  switching  surface.   After  the  design  is  com- 
pleted it  may  be  partially  justified  by  using  the  control- 
ler with  the  plant  for  a  set  of  representative  initial  con- 
ditions and  observing  the  performance.   This  is  an  after 
the  fact  type  of  evaluation  and  the  design  must  be  complete- 
ly redone  if  the  performance  is  not  acceptable.   Also,  as 
stated  above,  the  breakpoints  of  Smith's  pwl  surface,  the 
P(even)  in  the  notation  of  this  paper,  are  specified  prior 
to  the  least  squares  minimization.   This  allows  optimiza- 
tion of  only  one  half  of  the  available  pwl  parameters.   It 
should  be  observed  that  if  the  design  is  found  to  be  un- 
acceptable it  can  be  repeated  with  another  set  of  break - 
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points.   The  problem  with  this  procedure  is  that  previous 
trials  provide  little  information  of  value  in  selecting 
the  breakpoints  for  future  trials. 

Redderson  [4]  also  used  least  squares  fitting  tech- 
niques but  defined  his  cost  index  as 


(3.4)      J  -  I   (6t2)> 


i=l 

where  6  is  defined  as  the  transverse  trajectory  time  be- 
tween the  pwl  and  optimal  surfaces  as  shown  in  figure  10. 
x. 


x. 


Figure  10.   Transverse  Trajectory  Time 

Minimizing  this  index  relates  the  pwl  fitting  to  system 
response  time,  but  it  is  not  really  a  measure  of  overall 
performance.   Since  it  measures  trajectory  time  between 
the  surfaces  it  again,  as  does  Smith's  index,  only  assures 
that  they  will  be  close  together.   Actual  system  perform- 
ance must  be  evaluated  upon  completion  of  the  design  using 
representative  initial  conditions.   The  advantage  of  this 
method  over  Smith's  is  that  the  breakpoints  of  the  pwl  sur- 
face, as  well  as  the  slopes,  are  allowed  to  vary  which  re- 
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suits  in  optimizing  over  all  of  the  parameters.   This 
should  result  in  a  better  least  squares  fit  and,  if  indeed 
there  is  a  relationship  between  the  goodness  of  fit  and 
response  time,  better  system  performance.   Since  there  is 
no  definite  relationship  between  these  quantities  addi- 
tional response  -time  indices  should  be  considered  in  an 
effort  to  provide  better  suboptimal  response. 

3.4  Worst-Case  Response-Time  Indices 

The  difficulties  of  local  minima  with  the  summation 
indices  and  of  no  real  relationship  between  good  least 
squares  fit  and  good  system  response  can  be  avoided  by 
selecting  an  index  that  measures  the  worst  deviation  from 
optimal  performance  for  the  set  of  initial  conditions. 
Three  examples  of  this  type  of  index  are  given  below. 

a  .   * 

(3.5)  J,  =  max   t./t. 

1   x!0}_  x      x 

(3.6)  J  =  max   (t.  -  t.  ) 

xiOl   1   1 

(3.7)  J_  =  max   (t .  -  t.*)/t.* 

J    x(Q)    iii 

where 

A  th 

t.    =  pwl  response  time  for  l    initial  condition 

*  th 

t.    =   optimal  response  time  for  i    initial  condition 

x(0)  =   initial  condition  vector. 

The  cost  surface  is  generated  by  minimizing  the  indices 
with  respect  to  the  pwl  parameters.   The  design  can  then  be 
described  as  the  min-max  problem  which  has  been  studied  by 
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von  Neumann  [7]  and  others. 

* 

(3.8)      J   =  min  max  J 

P   x(0) 

where 

P  is  the  vector  of  pwl  parameters. 
As  noted  by  Kalman  [8]  the  minimum-time  problem  can  be  re- 
garded as  a  two-player  zero-sum  min-max  game.   That  is, 
nature  tries  to  maximize  response  time  while  man  tries  to 
minimize  it. 

Since  it  is  desired  that  the  index  selected  indicate 
desired  performance  and  generate  a  smooth  cost  surface, 
the  three  indices  were  evaluated  for  the  second-order  one 
pwl  segment  case.   Figure  11  shows  the  surfaces  as  P(l) 
varies  from  -7.45  to  -50.7  with  P(2)  set  at  +16.   J,  and 
J_  show  smooth  behavior  over  the  range  of  the  variable 
parameter.   J?  is  also  generally  smooth  but  does  show 
minor  irregularities.   The  points  plotted  are  the  costs 
for  a  set  of  24  initial  conditions  spaced  along  the  x..  co- 
ordinate axis. 

If  the  min-max  point,  J  as  given  by  equation  (3.8), 
can  be  found  the  designer  is  assured  that  system  perform- 
ance for  all  the  initial  conditions  can  be  no  worse  than 

* 

that  indicated  by  J  .   The  system  performance  for  other 

initial  conditions  within  the  design  range  will  be  dis- 
cussed in  sections  4  and  5.   Figure  11  shows  that  all 
three  indices  generate  easily  searched  cost  surfaces.   For 
the  design  method  to  be  presented  in  the  next  section  the 
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index  * 

vt. -t. 
(3.7)      J  =  max   (  ?;  a1 
2L101   ti 

was  chosen.   This  index  measures  the  worst  deviation  be- 
tween pwl  and  optimal  performance.   It  also  includes  the 
normalizing  factor  1/t   to  insure  that  all  initial  condi- 
tions are  equally  weighted  while  looking  for  the  one  with 
maximum  deviation.   As  an  example  of  the  necessity  for 
this  weighting,  consider  a  deviation  time  of  2  seconds. 
If  the  optimal  response  time  were  15  seconds  this  devia- 
tion would  probably  be  acceptable. 

J  =  ~  =    .1333 
Id 

However,  with  an  optimal  response  time  of  one  second,  the 

normalization  clearly  shows  that  this  performance  is  poor 

J  =  j   =  2.0 
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4f   DESIGN  OF  THE  PWL  SWITCHING  SURFACE 
4. 1   Steps  of  the  Design  Procedure 

In  order  to  obtain  acceptable  performance  from  the  pwl 
controller  it  is  necessary  to  determine  the  parameters  that 
minimize  the  cost  index  selected  in  the  last  section.   The 
steps  of  the  procedure  to  obtain  these  parameter  values 
are  listed  below. 

a.  Select  the  region  in  the  state  space  for  which 
the  design  is  desired  and  a  set  of  initial  condi- 
tions representative  of  this  region. 

b.  Obtain  the  optimal  response  times  for  the  select- 
ed initial  conditions. 

'       c.   Select  an  initial  set  of  parameters  to  define  a 
one  segment  pwl  switching  surface. 

d.  Evaluate  the  cost  index  to  determine  if  perform- 
ance of  the  controller  is  acceptable.   If  it  is 
acceptable  the  design  is  complete. 

e.  If  performance  is  not  acceptable,  vary  the  para- 
meters in  some  systematic  manner  to  improve  per- 
formance. 

f.  Repeat  steps  (d)  and  (e)  until  performance  is 
acceptable  or  no  further  improvement  is  possible. 

g.  When  no  further  improvement  is  possible  and  per- 
formance is  still  unacceptable,  increase  the  num- 
ber of  pwl  segments  by  one  by  defining  a  new  set 
of  initial  parameters. 

h.   Repeat  steps  (d)  through  (g)  until  acceptable  per- 
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formance  results  or  no  further  improvement  is 

possible. 
Thus  far,  it  has  been  stated  that  the  design  process 
is  completed  when  a  set  of  pwl  parameters  is  found  that 
produce  "acceptable"  performance  of  the  plant.   At  this 
point  it  is  necessary  to  define  this  acceptability  crite- 
rion.  The  procedure  outlined  above,  when  used  with  the 
cost  index  selected  in  the  last  section,  results  in  mini- 
mizing the  normalized  or  percentage  deviation  time  for  the 
set  of  initial  conditions.   By  defining  the  acceptability 
criterion  as  some  percentage  deviation  from  optimal  re- 
sponse time, 

(4.1)     J   =  — |     At   =  (t-t  )  acceptable 
a     t        a 

the  procedure  assures  that  the  system  will  respond  at  least 
this  well,  and  for  most  initial  conditions  it  will  be  bet- 
ter.  It  also  completes  the  design  using  the  minimum  number 
of  pwl  segments  and  upon  completion  of  each  cycle  indicates 
the  improvement  gained  by  the  addition  of  the  last  segment. 

The  value  selected  for  J   is  a  function  of  many  var- 
iables.  The  system  being  controlled,  its  employment,  allow- 
able cost  and  complexity  of  the  controller  are  all  factors 
that  must  enter  into  selection  of  the  acceptability  crite- 
rion.  The  designer  must  determine  how  close  to  the  optim- 
al he  desires  the  pwl  controller  to  operate  in  view  of  the 
above  factors.   After  the  pwl  parameters  are  selected  by 
the  design  procedure,  the  controller  must  be  implemented 
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using  pwl  function  generators  to  produce  the  control  as  a 
combination  of  the  state  variables  as  described  in  section 
2. 

4. 2   Selection  of  the  Initial  Conditions  and  Their  Range 

While  it  would  be  desirable  for  the  pwl  controller  to 
provide  acceptable  control  for  initial  conditions  through- 
out the  entire  state  space,  the  proposed  design  method  min- 
imizes the  cost  index  for  the  set  of  selected  conditions. 
From  an  engineering  standpoint  this  is  not  a  serious  re- 
striction since  for  most  physical  systems  a  range  of  ex- 
pected initial  conditions  can  usually  be  predicted.   The 
,  controller  must,  then,  provide  acceptable  control  over 
this  range  and  not  the  entire  state  space.   Consider  a 
shipboard  missile  launcher  as  an  example.   Under  normal 
conditions  this  system  would  be  at  some  initial  position 
with  no  velocity  or  acceleration.   Assume  that  the  system 
is  modeled  as  a  third  order  system  with  the  states  defined 
as 

x,  =  angle  of  launcher  with  respect  to  some  re- 
ference 

x«  =  angular  velocity 

x_  =  angular  acceleration. 
In  the  three  dimensional  state  space  the  possible  initial 
conditions  would  be  located  along  the  x,  coordinate  axis. 
The  range  of  the  initial  conditions  is  also  limited  in  this 
example  by  the  maximum  train  angle  of  the  launcher  which  is 
usually  restricted  to  somewhat  less  than  2ft   radians  by  such 
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things  as  electrical  cable  twist  and  structural  interfer- 
ence. 

It  can  be  shown  that  initial  conditions  lying  along 
the  pwl  surface  generally  respond  more  poorly  than  those 
located  in  other  regions  of  the  state  space.   In  view  of 
the  engineering  considerations  mentioned  above  and  the 
fact  that  placing  the  initial  conditions  along  the  pwl  sur- 
face requires  recomputation  of  optimal  response  times  after 
each  parameter  perturbation,  it  was  decided  to  place  them 
along  the  positive  x.  axis  for  the  second  order  examples 
presented  in  the  next  section.   This  corresponds  to  a  sys- 
tem with  initial  position  but  no  initial  velocity.   After 
the  set  of  initial  conditions  is  selected  for  which  the  con- 
troller is  to  be  designed,  the  optimal  response  times  neces- 
sary for  normalization  can  be  generated  once  and  need  not 
be  recomputed  after  each  change  in  parameter  settings. 
Selecting  the  initial  conditions  in  this  manner  introduces 
an  additive  constant  into  the  response  times,  because  each 
trajectory  moves  across  the  state  space  in  an  optimal  man- 
ner until  it  reaches  the  pwl  or  optimal  switching  surface 

at  which  time  it  begins  to  deviate  from  optimal  response, 
x. 


deviation  begins 
u  =  +1 

Figure  12.   Additive  Constant  in  the  Response  Time, 
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Figure  12  shows  the  additive  constant  that  results  from 
the  trajectories  crossing  the  state  space  before  starting 
to  deviate.   Notice  that  the  normalized  deviation  time 
index  used  in  this  design  procedure  removes  this  constant 
since  it  measures  only  the  deviation  from  optimal  response. 
If  a  summation  of  response  times  index  had  been  selected 
this  constant  could  affect  the  optimization  process  since 
it  might  reduce  the  differences  between  various  controllers 
so  that  the  best  design  was  not  readily  apparent. 

Since  the  minimization  of  the  cost  index  is  performed 
over  a  finite  set  of  initial  conditions,  it  is  necessary, 
upon  completion  of  the  design,  to  evaluate  the  system  res- 
ponse for  other  initial  conditions  in  the  range  of  interest. 
This  check  is  required  to  insure  that  there  are  no  points 
in  the  range  that  result  in  unacceptable  performance.   The 
smooth  shape  of  the  cost  surface  should  insure  that  once 
the  best  parameter  settings  are  found  for  a  large  enough 
set  of  initial  conditions,  all  others  in  the  range  will 
respond  acceptably  also. 

4. 3   Selection  of  the  Number  of  PWL  Segments 

In  the  design  of  the  pwl  controller,  it  is  desirable 
to  generate  the  control  using  the  minimum  number  of  pwl 
segments.   This  produces  both  the  least  complex  and  least 
costly  solution  to  the  problem  while  still  providing  ac- 
ceptable performance.   The  design  method  outlined  in  section 
4.1  has  this  desirable  feature.   If  the  performance  with  L 
segments  is  acceptable,  the  design  is  completed  and  there 
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is  no  need  to  evaluate  L+l  segments.  Smith  [2]  starts  his 
design  by  specifying  the  number  of  pwl  segments  to  be  used 
and  then  attempting  to  provide  good  performance  by  adjust- 
ing the  segment  slopes.  Redderson's  [4]  method  is  similar 
in  that  the  number  of  segments  is  prespecified,  but  both 
slopes  and  lengths  of  the  segments  are  allowed  to  vary. 

If  an  acceptability  criterion  that  allows  appreciable 
deviation  from  optimal  performance  is  selected,  linear 
switching  may  be  adequate.   Since  the  proposed  design  meth- 
od starts  with  one  segment,  it  will  be  evident  if  this  is 
true.   If  a  specified  number  of  segments  is  determined  to 
provide  unacceptable  control,  only  one  more  segment  is 
added  and  the  design  is  terminated  when  acceptability  is 
reached.   Therefore,  use  of  the  minimum  number  of  segments 
is  insured. 

Additionally,  it  is  possible  to  monitor  the  approach 
to  acceptability  by  comparing  the  best  cost  obtained  be- 
fore and  after  adding  a  segment.   If  the  improvement  is 
small,  the  acceptability  criterion  should  be  reviewed  to 
determine  if  it  is  too  strict  before  adding  additional  seg- 
ments which  increase  cost  and  complexity.   At  all  stages 
in  the  design  procedure  it  is  well  to  monitor  the  effect 
of  adding  a  segment  to  insure  that  the  design  is  completed 
using  the  minimum  number  of  segments. 

4.4   Searching  the  Cost  Surface 

With  the  cost  index,  the  set  of  initial  conditions 
and  the  initial  pwl  segments  selected,  once  the  method  of 
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searching  the  cost  surface  is  described  the  design  method 
is  complete.   For  a  second-order  pwl  switching  surface  of 
L  segments  the  cost  surface  is  a  function  of  2L-1  varia- 
bles.  This  2L-1  dimensional  space  must  be  searched  to  de- 
termine the  best  parameter  settings  for  the  controller. 
In  view  of  the  high  dimensionality  of  the  cost  surface,  an 
efficient  search  technique  must  be  used  to  minimize  the 
computer  time  required  for  the  design  process. 

Hooke  and  Jeeves  [9]  have  developed  a  direct  search 
technique  and  shown  that  computation  time  increases  roughly 
as  the  first  power  of  the  number  of  variables  not  as  the 
cube  as  is  the  case  for  most  classical  minimization  tech- 
niques.  This  direct  or  pattern  search  makes  use  of  past 
successful  parameter  adjustments  to  predict  possible  good 
future  moves.   The  search  establishes  a  pattern  of  impro- 
vement based  upon  the  success  of  individual  parameter  per- 
turbations.  The  size  of  the  pattern  grows  with  continued 
success,  thus  accelerating  the  search  toward  the  minimum. 
If  a  move  does  not  result  in  improvement,  the  size  of  the 
perturbation  is  reduced  until  improvement  results  or  a 
limiting  criterion  is  reached  and  the  search  is  terminated. 
A  more  detailed  description  of  the  pattern  search  may  be 
found  in  Appendix  A. 

The  pattern  search  was  chosen  for  the  minimization  of 
the  cost  index  in  this  study  because  of  its  relative  sim- 
plicity and  efficiency.   It  is  noted  that  this  search  is 
dependent  upon  the  perturbation  step  size  and  the  initial 
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parameter  settings.   More  efficient  search  methods  could 
probably  be  developed  to  accomplish  the  minimization  but 
it  is  felt  that  the  pattern  search  is  sufficient  for  this 
study.   The  next  section  will  present  two  examples  of  this 
method  used  to  design  controllers  for  second  order  systems. 


42 


5.   DESIGN  OF  SECOND-ORDER  PWL  CONTROLLERS 
The  real  test  of  any  design  method  for  pwl  switching 
surfaces  is  the  actual  performance  of  various  systems  when 
operating  with  the  pwl  controller.   This  section  presents 

two  examples  of  controller  design  for  second-order  systems. 

2 

Controllers  were  designed  for  1/s   and  l/s(s+a)  plants. 

The  systems  were  digitally  modeled  using  finite  state  dif- 
ference equations  for  simulation  on  an  IBM  360/67  high 
speed,  general  purpose  digital  computer.   The  results  of 
the  designs  are  presented,  and  a  comparison  with  control- 
lers designed  using  Smith's  [2]  least  squares  method  is 
made . 

2 
5. 1   Double  Integrator,  1/s  ,  Design  Example 

2 
The  double  integrator,  1/s  ,  plant  was  chosen  as  the 

first  example  to  test  the  feasibility  of  the  worst-case 

cost  index.   The  initial  conditions  were  spaced  along  the 

positive  x,  axis  as  described  in  section  4.2.   The  optimal 

response  times  for  the  set  of  initial  conditions  w  re  ob- 

tained  using  the  minimum-time  isochrones  for  the  plant. 

t*    m    X2(to)+    JO^Vtf+ZxfltJ  *±    >    -    |x2    I   X2    I 

(5.1)     =  !x2  I  xx  =  -  |*£  |  x2  | 

=  -x2(to)+v/-4x1(to)+2x22(to)   *   <  -  jx2  |  x2  | 


t  See  Athans  and  Falb  [3],  p  714 
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For  the  digital  simulation  of  the  system  the  discrete  dif- 
ference equations  for  the  plant  were  used. 

(5.2)    x1|_(K+l)TJ  =  x1(KT)+  T  x2(KT)+  j   T2  u(KT) 

x2j_(K+l)Tj  =  x2(KT)+  T  u(KT) 

These  difference  equations  were  used  to  reduce  the  comput- 
er time  required  to  generate  the  suboptimal  response  times 
which  are  necessary  when  evaluating  the  success  of  each  ex- 
ploratory and  pattern  move  in  the  pattern  search.   Initial- 
ly, fourth-order,  double  precision  Runga-Kutta  integration 
was  used,  but  computer  time  was  excessive.   Using  the  dif- 
ference equation  method  computer  time  was  approximately 
halved.   Although  the  difference  equation  solution  of  the 
plant  differential  equations  is  less  precise  than  the 
Runga-Kutta  integration,  no  loss  of  accuracy  was  observed 
when  points  describing  several  trajectories  were  compared. 

Rather  than  arbitrarily  specifying  an  acceptability 
criterion,  it  was  decided  to  allow  the  procedure  to  design 
the  best  possible  controller  for  this  first  example.   The 
fixed  parameter  and  the  variable  parameter  defining  a  one- 
segment  controller  were  selected  and  the  design  procedure 
accomplished.   The  results  of  this  design  are  presented  in 
figure  13. 


Initial 

Final 

Cost 

26.09 

.8433 

P(l) 

-1.0 

-9.41 

P(2) 

10.0 

10.0 

Figure  13.   One-Segment  Controller 
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A  comparison  of  the  pwl  and  optimal  switching  surfaces  is 

shown  in  figure  14. 
x 


Figure  14.   Optimal  and  Best  One-Segment  PWL  Surfaces 

The  final  cost  listed  in  table  I  indicates  that  the  one- 
segment  controller  causes  appreciable  deviation  from  op- 
timal response. 

In  order  to  improve  the  suboptimal  performance,  a 
second  pwl  segment  was  added  to  the  controller  as  called 
for  by  the  design  method  and  the  increased  set  of  parame- 
ters optimized.   The  results  are  presented  in  figure  15. 


- 

Initial 

Final 

Cost 

.8227 

.0907 

P(D 

-1.0 

-.9812 

P(2) 

1.0 

.4187 

P(3) 

-7.0 

-4.572 

P(4) 

10.0 

10.0 

Figure  15.   Two-Segment  PWL  Controller 
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The  two-segment  pwl  switching  surface  is  shown  with  its 
relationship  to  the  optimal  surface  in  figure  16. 


Figure  16.   Optimal  and  Best  Two-Segment  PWL 
Surfaces 


The  final  cost  of  the  two-segment  design  given  in  figure 
15  shows  that  the  worst  percentage  deviation  from  optimal 
response  is  approximately  nine,  percent.   If  an  acceptabil- 
ity criterion  of  more  than  this  value  had  been  selected 
the  pwl  controller  design  would  now  be  complete. 

In  order  to  determine  if  better  pwl  performance  was 
attainable,  a  third  segment  was  added  to  the  pwl  switching 
surface.   The  parameters  were  optimized  and  the  results 
are  presented  in  figure  17. 
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Initial 

Final 

Cost 

.2588 

.0511 

P(l) 

-1.305 

-.9456 

P(2) 

.744 

.3868 

P(3) 

-2.7 

-2.974 

P(4) 

5.0 

4.4 

P(5) 

-5.0 

-5.4 

P(6) 

16.0 

16.0 

Figure  17.   Three -Segment  PWL  Controller. 
The  addition  of  the  third  segment  to  the  switching  surface 
decreased  the  cost  by  only  .0  396  while  the  two-segment 
case  reduced  it  by  .7526  over  the  one-segment  case. 
Unless  extremely  close  to  optimal  control  is  desired,  the 
complexity  added  to  the  system  by  the  third  segment  may 
not  be  justified. 

This  example  has  shown  that  a  pwl  controller  can  be 

2 

designed  for  the  1/s   plant  that  results  in  no  more  than 

5.11  percent  deviation  from  optimal  response  time  for  the 
set  of  selected  initial  conditions.   As  mentioned  in  sec- 
tion 4.2,  a  check  must  be  made  using  other  sets  of  initial 
conditions  to  insure  that  the  design  is  acceptable  over 
the  entire  range.   The  two-segment  controller  of  figure  15 
was  evaluated  with  two  additional  sets  of  initial  condi- 
tions in  the  design  range.   in  both  cases  it  was  found 
that  all  initial  conditions  responded  acceptably  and  that 
the  parameter  settings  could  not  be  improved. 
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The  perturbation  step  size  and  initial  parameter 

value©  affect  the  cost  and  final  parameter  values  found  by 

[9] 
pattern  search  as  noted  by  Hooke  and  Jeeves.      In  the 

two  segment  design,  costs  were  found  to  vary  between  .3163 
and  .0907  depending  upon  the  step  size,   However,  it  was 
found  that  if  the  costs  for  different  step  sizes  were  the 
same,  the  parameter  settings  of  the  pwl  surface  selected 
by  the  search  also  agreed.   This  reinforces  the  assumption 
that  the  cost  surface  is  a  smooth  function  of  the  parame- 
ters .   To  insure  that  the  best  controller  design  results, 
several  step  sizes  and  initial  parameter  settings  should 
be  tried  if  the  pattern  search  is  used,  computer  times 
using  the  digital  model  given  in  Appendix  B  averaged  nine 
minutes  for  the  design  of  the  two-segment  controller  with 
the  IBM  360/67  computer.   The  three-segment  design  averaged 
13  minutes.   Since  computer  time  is  required  only  during 
the  design  of  the  controller,  these  averages  seem  a  reason- 
able price  to  pay. 

5,  2   1/s  (s-t a)  Design  Example 

The  last  example  showed  that  the  proposed  design  pro- 
cedure can  be  used  to  design  a  pwl  controller  that  provides 
acceptable  performance  for  second  order  systems.   As  a  se- 
cond example,  the  l/s(s+a)  plant  was  chosen.   This  plant  is 

2 
better  behaved  than  the  1/s   plant  since  it  has  a  pole  at 

s  ■  -a  that  results  in  a  term  of  the  form  exp(-at)  in  the 

time  response.   This  type  of  response  should  make  the  plant 

2 
easier  to  control  than  the  I/s   plant. 
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The  state  equations  for  this  plant  are 


(5.3) 


*l(t)  =  x2(t) 


x2(t)  =  -axJt)  +  u      a  >  0 


The  discrete  difference  equations  are  found  to  be 

x-[(K+l)T]  -  x1(KT)+(l/a-l/a  exp (-aT) ) x2 (KT) 
(5,4)  + ( -l/a2+T/a+exp ( -aT) /a2 ) U (KT) 

x2[(K+l)T]  =  exp(-aT)x2(KT)+(l/a+exp(-aT)/a)U(KT) 

The  initial  conditions  were  chosen  to  lie  along  the  x, 
axis  with  the  limit  at  x,  =15.   For  this  example  a  value 
of  a  =  1  was  used. 

The  optimal  response  times  and  the  set  of  initial  con- 
ditions were  generated  by  running  the  plant  backward  in 
time,  switching  the  control  once,  and  recording  the  time 
and  x,  coordinate  when  the  trajectory  intersected  the  x, 
axis.   A  word  of  caution  is  in  order  at  this  point  if  op- 
timal response  times  and  initial  conditions  are  to  be  ge- 
nerated in  this  manner.   For  this  plant  a  limit  line  oc- 
curs in  the  state  space  at  x~  =  -1/a  in  the  fourth  qua- 
drant and  at  x~  =  1/a  in  the  second  quadrant.   This  means 
that  trajectories  starting  to  the  right,  of  the  optimal 
switching  surface  and  above  the  limit  line  will  never  go 
below  x  =  -  1/a  before  reaching  the  origin.   Care  must  be 
taken  to  insure  that  switching  of  the  backward  time  tra- 
jectories does  not  take  place  below  the  limit  line  if  it 
is  desired  to  generate  a  set  of  initial  conditions  along 
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the  x,  axis. 

After  obtaining  the  optimal  response  times  and  ini- 
tial conditions,  the  design  process  begins  by  selecting  an 
initial  value  for  the  variable  parameter  of  a  one-segment 
pwl  switching  surface.   The  second  parameter  is  fixed  by 
the  range  of  initial  conditions.   For  this  example  P(2)=16 
was  selected.   Minimization  of  the  cost  index  using  the 
pattern  search  was  accomplished  with  the  results  recorded 
in  figure  18. 


Initial 

Final 

Cost 

.2098 

.00645 

P(l) 

-30.0 

-55.2 

P(2) 

16.0 

16.0 

Figure  18.   l/s(s+a)  One-Segment  PWL  Controller 

The  optimal  switching  surface  for  this  plant  is  very  nearly 

linear  as  shown  in  figure  19. 

x 


Limit  line 


Figure  19.  Optimal  Switching  Surface  for  l/s(s+a) 
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The  linearity  of  the  optimal  surface  allows  the  one-seg- 
ment pwl  surface  to  provide  control  that  is  very  close  to 
the  optimal.   The  maximum  percentage  deviation  from  opti- 
mal response  time  for  the  set  of  initial  conditions  is 
shown  in  the  table  to  be  .645%.   As  in  the  last  example 
two  other  sets  of  initial  conditions  in  the  design  range 
were  tested  with  a  pwl  controller  with  the  parameter  set- 
tings of  figure  18  and  no  worse  deviation  occurred  than 
that  found  upon  completion  of  the  design. 

Since  trajectories  for  initial  conditions  along  the 
x,  axis  cannot  pass  below  the  limit  line,  they  approach 
the  switching  line  as  shown  in  figure  19.   Trajectories 
from  initial  conditions  beyond  x,  =  3.8  reach  the  switch- 
ing line  very  close  to  its  intersection  with  the  limit 
line.   The  design  procedure  can  minimize  the  cost  index 
for  any  number  of  segments  by  passing  the  first  segment 
through  this  point  so  that  very  close  to  optimal  control 
results  as  it  did  in  the  one-segment  case.   A  second  pwl 
segment  was  added  to  the  pwl  switching  surface  to  see  if 
the  above  was  true  or  if  improvement  in  the  design  would 
result.   The  optimization  procedure  adjusted  the  first  seg- 
ment so  that  it  did  pass  through  the  intersection  and  a 
cost  identical  to  that  obtained  for  the  one-segment  design 
resulted.   If  the  first  segment  were  extended  the  same 
parameter  values  as  listed  in  table  IV  would  result.  After 
the  first  segment  is  extended  beyond  the  intersection,  the 
trajectories  no  longer  intersect  the  second  segment  and  no 
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change  in  the  initial  parameter  settings  is  made.   Since 
no  improvement  is  obtained  by  adding  the  second  pwl  seg- 
ment to  the  controller  the  design  is  completed  with  one- 
segment.   It  is  to  be  noted,  however,  that  this  probably 
would  not  be  the  case  for  initial  conditions  located  in 
other  regions  of  the  state  space.   The  procedure  could  be 
used  to  design  an  acceptable  controller  for  sets  of  ini- 
tial conditions  in  other  regions  of  the  state  space  if  the 
optimal   response  times  were  computed. 

5. 3   Comparison  of  Design  Methods. 

In  this  section  the  two-segment  pwl  controller  des- 
igned in  section  5.1  will  be  compared  with  controllers 

[2] 
designed  using  Smith's      least  squares,  fixed-breakpoint 

method.   For  the  first  the  x,  breakpoints  were  selected  by 
equally  dividing  the  range  of  interest  along  the  coordi- 
nate axis  as  specified  by  Smith.   This  resulted  in  one 
breakpoint  at  x..  =0  and  9.5.   The  least  squares  fit  was 
accomplished  to  determine  the  slopes  of  the  segments. 
Smith's  method  with  equally  spaced  breakpoints  gives  the 
following  parameter  values  when  converted  to  the  notation 
of  this  paper. 

Method    Proposed    Smith 

P(l)       -.9812      -4.67 

P(2)        .4187       9.5 

P(3)      -4.572       -4.917 

P(4)      10.0         19.0 
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The  pwl  switching  surface  of  section  5.1  and  that  designed 
with  the  least  squares  method  are  shown  below, 
x. 


Figure  20.   Comparison  of  Switching  Surfaces. 

A  second  controller  was  designed  for  comparison  using 
the  least  squares  method,  but  the  x,  breakpoint  used  was 
the  one  selected  by  the  proposed  method  for  the  best  two- 
segment  controller  given  in  figure  15.   The  parameters  re- 
sulting from  the  fit  are  given  below. 

Method     Proposed     Smith 

P(l)        -.9812        -.9959 

P(2)         .4187         .4187 

P(3)       -4.572        -4.1616 

P(4)       10.0  10.0 

The  controllers  were  compared  on  the  basis  of  maximum 
normalized  deviation  time  and  the  sum  of  pwl  response 
times  for  a  specified  set  of  initial  conditions.   The  re- 
sults are  listed  in  figure  21. 
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Method 

max(t-t  )/t 

*i 

Proposed 

.092 

71.460 

Smith  equal 
spacing 

1.716 

119.02 

Smith  best 
breakpoint 

.115 

73.594 

Optimal 

— 

66.8165 

Figure  21.   Comparison  of  Controller  Designs 

The  values  in  the  table  show  the  proposed  design  proce- 
dure is  significantly  better  than  Smith's  method  when 
evaluated  using  the  cost  index  of  this  paper  and  the  sum- 
mation of  response  times. 


54 


6 .   SUMMARY 

6.1   Discussion  of  Results 

The  problem  of  designing  an  easily-realized,  close-to- 
optimal  controller  was  studied.   It  was  specified  that  the 
control  law  be  realized  as  a  piecewise-linear  combination 
of  the  system  state  variables.   With  the  controller  in  this 
form,  the  problem  is  to  select  the  parameters  that  define 
the  pwl  switching  surface  which  provides  the  best  subopti- 
mal  performance. 

The  viewpoint  was  taken  that  deviations  from  optimal 
performance  would  be  accepted  if  savings  in  terms  of  cost 
and  complexity  could  be  achieved.   This  approach  led  to 
the  concept  of  acceptable  performance  of  the  controller. 
The  properties  of  various  cost  indices  were  investigated, 
and  the  decision  was  made  that  a  response-time  index 
should  be  selected  rather  than  a  heuristic  one  such  as 
the  least  squares  polynomial  fit.   The  problems  associated 
with  summation  of  response-time  indices  were  explored,  and 
no  solution  was  readily  apparent.   The  worst-case  indices 
were  then  evaluated,  and  it  was  determined  that  if  the 
min-max  point  can  be  found,  a  controller  can  be  designed 
that  will  provide  acceptable  performance  for  the  region  of 
interest  in  the  state  space. 

A  design  procedure  that  provides  acceptable  control 
while  requiring  the  minimum  number  of  pwl  segments  was  pro- 
posed.  Performance  of  the  method  for  second-order  systems 
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was  demonstrated  by  example  and  a  comparison  of  perform- 

[2] 
ance  was  made  with  Smith's     least  squares  method.   The 

results  of  the  comparison  showed  that  the  design  method 
of  this  paper  produced  a  significantly  better  controller. 
The  design  method  of  section  4.1  resulted  in  controllers 
that  allowed  only  slight  deviations  from  optimal  perform- 
ance.  Additionally  the  controllers  are  simple  to  imple- 
ment since  they  use  the  minimum  number  of  pwl  segments. 

6.2   Areas  for  Further  Study 

Although  this  study  has  shown  the  merits  of  using 
the  worst-case  cost  index,  many  areas  of  the  suboptimal 
switching  problem  are  open  to  further  study.   Perhaps  the 
most  important  addition  to  this  work  would  be  its  exten- 
sion to  third  and  higher  order  systems.   As  noted  previous- 
ly, all  system  simulations  were  accomplished  using  a  purely 
digital  model.   The  use  of  a  hybrid  model  should  be  invest- 
igated since  a  considerable  saving  in  computer  time  requir- 
ed for  the  design  could  be  realized.   The  numerous  integra- 
tions necessary  to  generate  the  pwl  response  times  are 
more  suitable  to  analog  simulation  while  the  logic  capabi- 
lities of  digital  computation  are  necessary  for  parameter 
optimization. 

The  pattern  search  as  used  with  this  design  method 
should  be  investigated  to  see  if  it  can  be  modified  to  re- 
move its  dependence  upon  parameter  step  size  and  starting 
point  of  the  search.   In  the  example  studies  of  section 
5.1  and  5.2,  it  was  determined  that  certain  combinations 
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of  step  size  and  initial  parameter  settings  caused  the 
search  to  terminate  prior  to  reaching  the  minimum  of  the 
cost  surface.   It  is  desired  that  the  search  reach  the 
min-max  point  under  all  conditions.   Perhaps  a  new  search 
technique  especially  suited  for  finding  the  min-max  solu- 
tion regardless  of  the  starting  conditions  can  be  developed. 
The  feasibility  of  searching  the  range  of  initial  con- 
ditions in  an  effort  to  locate  the  true  min-max  should  be 
investigated.   It  is  possible  that  a  point  exists  in  the 
range  of  initial  conditions  that  results  in  worse  deviation 
than  that  found  for  the  finite  set  used.   In  the  examples 
of  section  5  other  sets  of  initial  conditions  in  the  de- 
sign range  were  used  to  check  for  possible  worse  points. 
This  check  showed  no  worse  points,  however,  it  did  not 
prove  that  none  exist. 
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APPENDIX  A 

Pattern  Search  for  Cost  Index  Minimization 

[9] 
The  pattern  search  technique  of  Hooke  and  Jeeves     is 

a  "direct  search"  in  that  sequential  trial  solutions  are 
compared  to  the  previous  "best"  solution  to  determine  the 
next  trial  solution.   The  search  minimizes  a  function  of 
several  variables,  S(p),  by  determining  the  sequence  of 
values  of  p  that  provide  improvement  in  the  function  value, 
Two  types  of  moves  are  made  in  the  search.   Explorato- 
ry moves  are  made  about  a  selected  base  point  by  changing 
each  variable  by  a  selected  step  size.   Each  exploratory 
move  is  successful  if  S(p)  decreases.   The  exploratory 
moves  provide  information  about  the  behavior  of  the  func- 
tion being  searched.   The  successful  exploratory  moves  are 
formed  into  a  pattern  indicating  the  direction  of  a  move 
that  will  probably  be  successful  in  reducing  the  value  of 
the  function.   The  sequence  of  exploratory  moves  and  the 
establishment  of  a  pattern  is  shown  in  figure  A-l. 
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Figure  A-l.  Exploration  and  Pattern  Establishment 
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Starting  at  the  first  base  point  in  the  figure,  point 
b  ,  p(l)  is  varied  by  -A  and  S(p)  is  evaluated.   If  the 
value  of  the  function  is  reduced  the  move  is  successful 
and  point  a,  would  become  the  new  base  point  for  further 
exploration.   For  the  case  shown,  the  -A,  move  is  not  suc- 
cessful so  +A,  is  tried  and  found  to  be  successful.   Point 
a_  now  becomes  the  base  point  for  variation  of  p(2).   A 
step  of  +A?  is  now  made  in  p(2)  and  found  to  be  success- 
ful. Point  b2  is  then  designated  the  new  base  point. 

Rather  than  repeating  the  sequence  of  exploratory  moves 
around  the  new  base  point,  a  pattern  move  is  made  that  re- 
peats the  combined  moves  from  the  previous  base  point  b  . 
That  is,  all  variables  are  again  changed  by  the  amount 
that  was  necessary  to  reach  the  present  base  point.   In 
figure  A-l  the  pattern  move  is  made  from  b1  to  c.   If  the 
move  is  successful,  a  new  set  of  explorations  is  made,  a 
new  base  point  is  found,  and  the  pattern  move  is  repeated. 
This  process  tends  to  accelerate  the  search  as  shown  in 

figure  A-2. 
P(2) 


P(D 


Figure  A-2.   Acceleration  of  Pattern  Moves 


60 


Start 


Evaluate  function  at 
initial  base  point 


Start  at 
Base  Point 


Decrease 
step  size 


Make 
Exploratory 
Moves 


Set  new 
base  point 


Make  pattern 
move 


I 


Make  Explora- 
tory moves 


Yes 


Stop 


i\ 


Figure  A-3.   Pattern  Search  Flow  Diagram 
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If  the  pattern  move  is  unsuccessful,  the  pattern  is 
destroyed  and  exploration  is  made  about  the  last  base 
point  in  order  to  develop  a  new  pattern.  It  may  be  ne- 
cessary to  reduce  the  exploration  step  size  in  order  to 
reestablish  a  good  pattern.  After  finding  a  new  direc- 
tion to  move,  the  pattern  will  grow  in  size  as  described 
above . 

When  the  search  has  reached  the  region  of  the  minimum 
of  S(p),  the  step  size  is  decreased  in  order  to  continue 
improvement.   When  the  step  size  has  reached  prespecified 
minimum  size,  the  search  will  terminate,  and  the  variables 
have  the  values  for  which  the  function  reaches  its  mini- 
mum.  A  flow  diagram  for  the  pattern  search  is  shown  in 
figure  A-3. 
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APPENDIX  B 


Computer  Programs 

2 

1/s   Two-Segment  Example 
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